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(54) MOVING IMAGE PROCESSING UNIT 
(57)Abstract: 

PURPOSE: To allow a processing unit to cope with plural transmission rates 
inexpensively by processing an image by a system based on orthogonal 
conversion coding of a moving image. 

CONSTITUTION: A DCT circuit 12 applies discrete cosine transformation to a 
CIF image received from an input terminal 10, and a quantization device 14 
quantizes a DCT coefficient. Masking processing circuits 16A, 16B mask a high 
frequency component in an output of the quantization device 14 to zero based 
on a control signal from buffers 20A, 20B. When the code quantity in the buffers 
20A, 20B is increased, the masked part is spread toward a low frequency and 
when decreased, the masking area is made narrow. Huffman coders 18A, 18B 
apply Huffman coding to the output of the masking processing circuits 16A, 16B 
and the buffers 20A, 20B store tentatively a code string outputted from the 
coders 18A, 18B and provide an output to communication interfaces 22A, 22B in 
matching with the transmission rate of transmission lines 24A, 24B. 
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CLAIMS 
[Claim(s)] 

[Claim 1] Time-varying-image-processing equipment characterized by providing 
the mask means which is time-varying-image-processing equipment which 
processes the dynamic-image coded data which uses orthogonal transformation 
coding as the base, and carries out the mask of a part of multiplier after 
orthogonal transformation, and an amount detection means of signs to detect 
the amount of signs and to control the mask range in the mask means 
concerned according to the detection result. 

[Claim 2] Time-varying-image-processing equipment according to claim 1 with 
which the above-mentioned mask means carries out the mask of the multiplier 
after the predetermined ranking in the order of a zigzag scan. 
[Claim 3] The orthogonal transformation means which carries out orthogonal 
transformation of the input dynamic image, and a quantization means to 
quantize the output of the orthogonal transformation means concerned, The 
mask means which carries out the mask of a part of quantized orthogonal 
transformation multiplier which is outputted from the quantization means 



concerned, Time-varying-image-processing equipment characterized by 
providing the entropy-code-modulation means which carries out entropy code 
modulation of the output of the mask means concerned, and an amount 
detection means of signs to detect the amount of output signs of the 
entropy-code-modulation means concerned, and to control the mask range in 
the mask means concerned according to the detection result. 
[Claim 4] Time-varying-image-processing equipment according to claim 3 with 
which the above-mentioned mask means carries out the mask of the multiplier 
after the predetermined ranking in the order of a zigzag scan. 
[Claim 5] A decryption means to be time-varying-image-processing equipment 
which carries out rate conversion of the dynamic-image coded data which uses 
orthogonal transformation coding as the base, and to decrypt input 
dynamic-image coded data in the phase of orthogonal transformation multiplier 
data, The mask means which carries out the mask of a part of part equivalent to 
the multiplier data after orthogonal transformation according to the block 
information by the decode result of the decryption means concerned, and the 
information on a sign boundary etc., Time-varying-image-processing equipment 
characterized by providing an amount detection means of signs to detect the 
amount of output signs of the mask means concerned, and to control the mask 
range in the mask means concerned according to the detection result. 



[Claim 6] Time-varying-image-processing equipment according to claim 5 with 
which the above-mentioned mask means carries out the mask of the multiplier 
after the predetermined ranking in the order of a zigzag scan. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] More specifically, this invention relates to the 
time-varying-image-processing equipment in the dynamic-image transmission 
system which treats a dynamic image by the coding method which uses 
orthogonal transformation coding as the base about 
time-varying-image-processing equipment. 
[0002] 

[Description of the Prior Art] Motion which puts in a row H.261, MPEG, and the 
image by which JPEG coding was carried out to the method which carries out 
compression coding of the dynamic image for transmission There is JPEG. 
Since there is no guarantee with the same transmission rate of the transmission 
line to an every place point when transmitting a dynamic image to many points, it 



is necessary to enable it to correspond to two or more transmission rates. 
Specifically, there are a method which determines compressibility or the amount 
of generating signs according to the lowest transmission rate of two or more 
transmission lines, and a method which prepares the encoder of compressibility 
set by each transmission rate. 
[0003] 

[Problem(s) to be Solved by the Invention] the equipment or the user who has 
secured the transmission line of a high rate in the case of the former -- also 
receiving - low - there is a big fault that a dynamic image can be transmitted 
only by quality image quality. On the other hand, although there is no such 
un-arranging, in the case of the latter, an encoder must be prepared for every 
transmission rate, and there is a problem that an equipment scale becomes 
large and becomes cost quantity in it. 

[0004] Furthermore, when transmitting the dynamic image transmitted from other 
equipments to many points with the conventional method through two or more 
transmission lines where transmission rates differ (i.e., when acting as 
intermediary), the dynamic-image coded data which received is returned to an 
orthogonal transformation multiplier, and entropy code modulation of this will be 
carried out again, and it will transmit. That is, the entropy decryption of the 
dynamic-image coded data which received is carried out, the reverse-quantized 



processing is needed, and there is also a problem that these processings take 
time amount. 

[0005] This invention aims at showing such inconvenient 

time-varying-image-processing equipment that is not produced. 

[0006] 

[Means for Solving the Problem] The time-varying-image-processing equipment 
concerning this invention is time-varying-image-processing equipment which 
processes the dynamic-image coded data which uses orthogonal transformation 
coding as the base, and is characterized by to provide the mask means which 
carries out the mask of a part of multiplier after orthogonal transformation, and 
an amount detection means of signs detect the amount of signs and control the 
mask range in the mask means concerned according to the detection result. 
[0007] An orthogonal transformation means by which the 
time-varying-image-processing equipment concerning this invention carries out 
orthogonal transformation of the input dynamic image again, A quantization 
means to quantize the output of the orthogonal transformation means concerned, 
and the mask means which carries out the mask of a part of quantized 
orthogonal transformation multiplier which is outputted from the quantization 
means concerned, It is characterized by providing the entropy-code-modulation 
means which carries out entropy code modulation of the output of the mask 



means concerned, and an amount detection means of signs to detect the 
amount of output signs of the entropy-code-modulation means concerned, and 
to control the mask range in the mask means concerned according to the 
detection result. 

[0008] A decryption means for the time-varying-image-processing equipment 
concerning this invention to be time-varying-image-processing equipment which 
carries out rate conversion of the dynamic-image coded data which uses 
orthogonal transformation coding as the base again, and to decrypt input 
dynamic-image coded data in the phase of orthogonal transformation multiplier 
data, The mask means which carries out the mask of a part of part equivalent to 
the multiplier data after orthogonal transformation according to the block 
information by the decode result of the decryption means concerned, and the 
information on a sign boundary etc., The amount of output signs of the mask 
means concerned is detected, and it is characterized by providing an amount 
detection means of signs to control the mask range in the mask means 
concerned according to the detection result. 

[0009] With any time-varying-image-processing equipment, the mask means 
concerned carries out the mask of the multiplier after the predetermined ranking 
in the order of a zigzag scan preferably. 
[0010] 



[Function] It becomes possible to make it correspond to the various transmission 
rates in the phase of the quantized orthogonal transformation multiplier with the 
above-mentioned means. It can respond now to two or more transmission rates 
by the easier equipment configuration than before by this, and conversion of a 
transmission rate can also be easily performed now. 
[0011] 

[Example] Hereafter, the example of this invention is explained to a detail with 
reference to a drawing. 

[0012] Drawing 1 shows the outline configuration block Fig. of the first example 
of this invention. In drawing 1 , the quantizer with which the image entry-of-data 
terminal of a CIF format and 12 quantize a discrete cosine transform (DCT) 
circuit, and, as for 14, 10 quantizes the output (transform coefficient) of the DCT 
circuit 12, and 16A and 16B are masking processing circuits which mask the 
output (high-frequency component beyond an assignment value of the transform 
coefficient outputted from the DCT circuit 12) of a quantizer 14. The detail of 
Circuits 16A and 16B is mentioned later. 18A and 18B are Huffman coding 
circuits which carry out Huffman coding of the output of the masking processing 
circuits 16A and 16B, respectively. 

[0013] 20A and 20B are FIFO buffers which buffer the output sign of the Huffman 
coding circuits 18A and 18B, and the information about the amount of signs 



memorized is impressed to the masking processing circuits 16A and 16B as a 
control value. 22A and 22B are communication link interfaces which output the 
output sign of the Huffman coding circuits 20A and 20B buffered by Buffers 20A 
and 20B to the transmission lines 24A and 24B of transmission rate 128kbps 
and 256kbps, respectively. 

[0014] That is, Circuits 16A, 18A, 20A, and 22A are designed for transmission 

rate 128kbps, and Circuits 16B, 18B, 20B, and 22B are designed for 

transmission rate 256kbps. When the processor corresponding to other 

transmission rates is required, the same processor is prepared in juxtaposition at 

Circuits 16A, 18A, and 20A, 22A;16B, and 18B, 20B and 22B. 

[0015] The input image of a GIF format in the example shown in drawing 1 is 

Motion. It becomes the compression sign compressed by JPEG. 

[0016] The DCT circuit 12 takes out and carries out the discrete cosine transform 

of the image data in order of the block of 8x8 from the CIF image inputted from 

an input terminal 10. A quantizer 14 quantizes the DCT multiplier outputted from 

the DCT circuit 12. 

[0017] The masking processing circuits 16A and 16B mask the RF part of a DCT 
multiplier 0 according to the control signal from Buffers 20A and 20B, 
respectively. The part masked by 0 in the plot plan of the DCT multiplier shown 
in drawing 2 is a shadow area, and the field which is not masked serves as a 



square of DC component approach. The square field where the masking 
processing circuits 16A and 16B will not be masked according to the amount of 
signs if the amount of signs in Buffers 20A and 20B increases is narrowed at a 
low frequency component side, and conversely, if the amount of signs in Buffers 
20A and 20B decreases, the field of the square which is not masked will be 
extended to a high-frequency component side. 

[0018] The Huffman coding machines 18A and 18B carry out Huffman coding of 
the output of the masking processing circuits 16A and 16B, and Buffers 20A and 
20B store temporarily the sign train outputted from the Huffman coding 
machines 18A and 18B, and they output them to the communication link 
interfaces 22A and 22B so that the transmission rate of transmission lines 24A 
and 24B may be suited. 

[0019] Buffers 20A and 20B are monitoring continuously the number of bits 
memorized inside, and control the masking processing circuits 16A and 16B to 
become a constant rate with the storage number of bits. That is, as explained 
previously, Buffers 20A and 20B send the control signal which narrows a 
masking field for the control signal which extends 0 masking field when there are 
little delivery and are recording number of bits to the masking processing circuits 
16A and 16B, when there is much are recording number of bits. 
[0020] Communication link interface 22A transmits the coded data from buffer 



20A to transmission-line 24A of 128kbps(es), and communication link interface 
22B transmits the coded data from buffer 20B to transmission-line 24B of 
256kbps(es). 

[0021] Thus, in the example shown in drawing 1 , it can respond to many 
transmission rates only by forming the DCT circuit 12 and one quantizer 14, 
respectively. What is necessary is just to add the same processor as Circuits 
16A, 18A, 20A, and 22A, if it puts in another way. 

[0022] Drawing 3 shows the outline configuration block Fig. of the 2nd example 
of this invention applied to the repeating installation which changes and relays 
dynamic-image coded data to a different transmission rate. In the example 
shown in drawing 3 , the coded data which received by transmission rate 
384kbps is re-outputted to the transmission line of transmission rate 64kbps, and 
the transmission line of transmission rate 128kbps. 

[0023] The input terminal into which the data from the transmission line of 
transmission rate 384kbps input 30, A communication link interface with the 
transmission line which connects 32 to an input terminal 30, the Huffman 
decoder which carries out the Huffman decryption of the received data 
(dynamic-image coded data) with which 34 is outputted from the communication 
link interface 32, 36A and 36B use the output of the Huffman decoder 34, 
respectively. According to the amount of signs which should be outputted to a 



transmission line, the amount control circuit of signs which controls the amount 
of signs of the dynamic-image coded data outputted from the communication link 
interface 32, and 38A and 38B It is the FIFO buffer which buffers the output sign 
of the amount control circuits 36A and 36B of signs, and the information about 
the amount of signs memorized is impressed to the amount control circuits 36A 
and 36B of signs as a control value. 40A and 40B are communication link 
interfaces which output the output sign of the amount control circuits 36A and 
36B of signs buffered by Buffers 38A and 38B to the transmission lines 42A and 
42B of transmission rate 64kbps and 128kbps, respectively. 
[0024] Circuits 36A, 38A, and 40A are designed for transmission rate 64kbps, 
and Circuits 36B and 38B and 40BB are designed for transmission rate 128kbps. 
When the processor corresponding to other transmission rates is required also 
for drawing 3 , it should just prepare the same processor in juxtaposition at 
Circuits 36A and 38A, 40A;36B, and 38B and 40B. 

[0025] Actuation of the example shown in drawing 3 is explained. First, the 
dynamic-image data by which JPEG coding was separately carried out in each 
frame transmit the transmission line of 384kbps, and input into the 
communication link interface 32 from an input terminal 30, and, as for the 
communication link interface 32, dynamic-image coded data is impressed to the 
Huffman decoder 34 and the amount control circuits 36A and 36B of signs. The 



Huffman decoder 34 decrypts Huffman coding of the dynamic-image coded data 
from the communication link interface 32, and directs the zero run length, 
multiplier, and sign boundary of each symbol within the head location of block 
information, and a block to the amount control circuits 36A and 36B of signs. 
[0026] The amount control circuits 36A and 36B of signs receive the 
above-mentioned information from the Huffman decoder 34, output information, 
such as a header, as they are among the outputs of the communication link 
interface 32, and mask AC multiplier n-th after the order of a zigzag scan by 0 to 
each block information from DC multiplier to EOB (EOB). Thereby, the amount of 
signs decreases. This variable n takes the values from 1 to 63, and this value is 
fluctuated by the amount information of signs from Buffers 38A and 38B. When 
referred to as n= 1 , 0 is masked [ no ] for AC multipliers, and masking processing 
is performed when referred to as n= 63. 

[0027] Buffers 38A and 38B store temporarily the sign train outputted from the 
amount control circuits 36A and 36B of signs, and they output it to the 
communication link interfaces 40A and 40B so that the transmission rate of 
transmission lines 42A and 42B may be suited. Buffers 38A and 38B are 
monitoring continuously the number of bits memorized inside like Buffers 20A 
and 20B, and control the amount control circuits 36A and 36B of signs to 
become a constant rate with the storage number of bits. That is, if Buffers 38A 



and 38B become less than the predetermined value from which delivery and the 
are recording number of bits are the same, or differ the control signal which 
directs the amount reduction of signs if the are recording number of bits 
increases more than a predetermined value in the amount control circuits 36A 
and 36B of signs, they will send the control signal which directs the increment in 
the amount of signs to them. 

[0028] Communication link interface 40A outputs the coded data from buffer 38A 
to transmission-line 42A of 64kbps(es), and communication link interface 40B 
transmits the coded data from buffer 38B to transmission-line 42b of 
128kbps(es). 

[0029] Drawing 4 shows an example of the amount control of signs by the 
amount control circuits 36A and 36B of signs. Drawing 4 is the case where AC 
multiplier of 25 (=n) watch henceforth is transposed to 0. The number of AC 
multipliers which are not 0 run length and 0 is counted, and masking by 0 is 
performed by removing the sign about AC component of the n-th henceforth. As 
explained previously, Buffers 38A and 38B will supply the amount reduction 
control signal of signs to the amount control circuits 36A and 36B of signs, if the 
amount of data to memorize increases, and if the amount of data to memorize 
decreases, they will supply the increment control signal in the amount of signs to 
the amount control circuits 36A and 36B of signs conversely, according to the 



amount reduction control signal of signs, the amount control circuits 36A and 
36B of signs make Variable n small, increase the number of AC multipliers 
replaced with 0, enlarge Variable n conversely according to the increment 
control signal in the amount of signs, and transpose it to 0 - un— the number of 
AC multipliers of 0 is lessened. 

[0030] In case rate conversion is carried out and it transmits, it becomes 
unnecessary to carry out Huffman coding again in the example shown in drawing 
3 , since the replacement by 0 of an orthogonal transformation multiplier is 
performed in front from the back end of a zigzag scan. Moreover, a transmission 
rate can be changed only by deleting a part of coded data which received from 
the high rate transmission line, and there is an advantage that it is realizable in 
an easy circuit. Therefore, there is little processing time and it ends again. 
[0031] Drawing 5 shows the outline configuration block Fig. of the 3rd example 
of this invention applied to the CD-ROM regenerative apparatus. In drawing 5 , 
CD-ROM, as for 50, MPEG coding dynamic-image data were remembered to be, 
and 52 The Huffman decoder which carries out the Huffman decryption of the 
coding dynamic-image data reproduced from CD-ROM50, and 54 The amount of 
signs of the coding dynamic-image data reproduced from CD-ROM50 by the 
same method as the amount control circuits 36A and 36B of signs The amount 
control circuits 36A and 36B of signs, and the amount control circuit of signs 



controlled by the same method, The amount counter of signs which controls the 
amount control circuit 54 of signs so that 56 counts the amount of signs 
outputted from the amount control circuit 54 of signs and the amount of signs 
concerned becomes constant value, The FIFO buffer in which 58 buffers the 
output of the amount counter 56 of signs, and 60 are communication link 
interfaces which supply the output of a buffer 58 to the transmission line 62 of 
transmission rate 1 Mbps. 

[0032] Actuation of the example shown in drawing 5 is explained. MPEG coded 
data is read from CD-ROM50 one by one, and it is impressed by the Huffman 
decoder 52 and the amount control circuit 54 of signs. The Huffman decoder 52 
decodes MPEG coded data, and directs 0 run length, multiplier, and sign 
boundary of each symbol within the head location of block information, and a 
block to the amount control circuit 54 of signs. As for the Huffman decoder 52, 
the sign train under processing directs whether it is which picture of I picture, P 
picture, and B picture to the amount counter 56 of signs again. 
[0033] Although the amount control circuit 54 of signs sends various information, 
such as a header, to the amount counter 56 of signs as they are among the 
MPEG code data trains read from CD-ROM50, it permutes the DCT multiplier 
n-th after the order of a zigzag scan for each block information by 0 as a 
processing object according to the amount control signal of signs from the 



amount counter 56 of signs. The amount control circuit 54 of signs deletes the 
symbolic language to the DCT multiplier of the n-th henceforth with a zigzag 
scan out of the sign sequence within block information. However, this shall not 
be removed when there is only one multiplier which is not 0 into a block. Variable 
n takes the values from 1 to 63, and this value is determined by the control signal 
from the amount counter 56 of signs. 

[0034] The amount counter 56 of signs has a FIFO buffer inside, writes the data 
outputted from the amount control circuit 54 of signs in the internal buffer, and by 
the picture identification information from the Huffman decoder 52, when the 
data under current processing are data of I picture, in the case of a rate Ri and P 
picture, in the case of a rate Rp and B picture, it reads data from the internal 
buffer concerned at a rate Rb, and it transmits them to FIFO buffer 58. The 
amount counter 56 of signs is always supervising the number of bits 
accumulated in the internal buffer, and when [ than a constant rate with the are 
recording number of bits ] more, if they are delivery and below a certain constant 
rate in the amount control circuit 54 of signs about the control signal which 
makes Variable n small, it will send the control signal which enlarges Variable n 
to the amount control circuit 54 of signs. Rates Ri, Rp, and Rb are 
control-objectives rates of I picture, P picture, and B picture, respectively, and 
they are set up so that it may be set to 1 Mbps on the average. 



[0035] FIFO buffer 58 reads data at the rate of 1Mbps, and supplies the data to 
memorize to the communication link interface 60, and the communication link 
interface 60 sends out the data from a buffer 58 to the transmission line 62 of 
1Mbps. 

[0036] It is clear not to be limited to the example which this invention mentioned 
above. For example, at the above-mentioned example, it is Motion as a coding 
method of a dynamic image. Although the JPEG method or the MPEG method 
was used, it is clear that you may be other dynamic-image coding methods 
which use orthogonal transformation, such as ITU-T recommendation H.261, as 
the base. 
[0037] 

[Effect of the Invention] According to this invention, it becomes possible to make 
it correspond to transmission rates various in the phase after quantization so that 
he can understand easily from the above explanation. Therefore, it can respond 
now to many transmission rates more in a small circuit. 

[0038] Moreover, since it stops needing reverse quantization according to this 
invention when changing the transmission rate of the already encoded 
dynamic-image data, rate transform processing is simply [ at high speed and ] 
realizable. 

[0039] Furthermore, the rate control after Huffman coding is attained because it 



considers as the means which carries out the mask of a part of multiplier after 
orthogonal transformation and is made to carry out the mask of the multiplier of 
the watch henceforth of the arbitration of the order of a zigzag scan. 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

f Drawing 1] It is the outline configuration block Fig. of the 1st example of this 
invention. 

[Drawing 2] It is drawing showing the masking processing field to the DCT 

multiplier of 8x8 by the masking processing circuits 16A and 16B. 

[Drawing 3] It is the outline configuration block Fig. of the 2nd example of this 

invention. 

[Drawing 4] It is an example of masking processing in the example shown in 
drawing 3 . 

fDrawing 5] It is the outline configuration block Fig. of the 3rd example of this 
invention. 

[Description of Notations] 
10: Input terminal 



12: DCT circuit 
14: Quantizer 

16A, 16B: Masking processing circuit 
18A, 18B: Huffman coding machine 
20A, 20B: Buffer 

22A, 22B: Communication link interface 
24A: The transmission line of 128kbps 
24B: The transmission line of 256kbps 
30: Input terminal 
32: Communication link interface 
34: Huffman decoder 

36A, 36B: The amount control circuit of signs 

38A, 38B: FIFO buffer 

40A, 40B: Communication link interface 

42A: The transmission line of transmission rate 64kbps 

42B: The transmission line of transmission rate 128kbps 

50: CD-ROM 

52: Huffman decoder 

54: The amount control circuit of signs 

56: The amount counter of signs 



58: FIFO buffer 

60: Communication link interface 

62: The transmission line of transmission rate 1Mbps 



